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ABSTRACT 

We present the third release of the AMBER data reduction software by the JMMC. This software is based on 
core algorithms optimized after several years of operation. An optional graphic interface in a high level language 
allows the user to control the process step by step or in a completely automatic manner. Ongoing improvement 
is the implementation of a robust calibration scheme, making use of the full calibration sets available during 
the night. The output products are standard OTFITS hies, which can be used directly in high level software 
like model fitting or image reconstruction tools. The software performances are illustrated on a full data set of 
,— i calibrators observed with AMBER during 5 years taken in various instrumental setup. 
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i 1 1. INTRODUCTION 

<^5 AMBER is the near infrared (1000-2500 nm), three-telescope, interferometric beam combiner of the VLTI. 1 

AMBER recombination scheme provides spatially coded fringes on an infrared camera. The data processing 

i-£h involves the modeling of the interferogram in the detector plane. Most of the basic data reduction involves the 

calibration, and the use of a linear relationship between the pixels of the interferogram and the three instantaneous 
O complex visibilities, known as Pixel-to- Visibility Matrix (P2VM). 2 

The data reduction algorithms of AMBER have been incorporated in the instrument software itself^ early 

in its building, in the form of a C library of functions named amdlib.^ The AMBER consortium has developed 

the library for some time and the last version implemented at ESO is amdlibv2. This library provides the basic 

I functions like the computation of the P2VM, the real-time measurement of various quantities used in monitoring 

^. the observation: atmospheric pistons between telescopes, instantaneous photometries, estimates of V 2 , fringe 

contrast. . . The same library is also used in the ESO data reduction pipeline for AMBER. 5 The C package is 

complete in the sense that it provides also the basic command-line tools necessary to "reduce" observations and 

~l its final product is uncalibrated OTFITS files. 



t> 



Following the delivery of the instrument to ESO, the amdlib library maintenance has been taken over by 
the Jean-Marie Mariotti Expertise CentreQ however retaining most of the initial authors, and has now been 
augmented by a Graphical User Interface and scripting facility written in YoriclP (Sect. [3]), with supplementary 
absolute calibration procedures (Sect. |3.3[ ). Besides, after several years of use of the instrument, that produced 
£> numerous scientific results (see, e.g., the A&A special issue 464, 2007), the knowledge of the instrument behaviour 

( "true instrument" ) that we have acquired during several commissioning runs allowed us to improve considerably 
the calibration procedure and data reduction scheme. The sum of all this effort is now available with version 3 
of the "Amber Data Reduction Package" , whose changes compared to the previous versions are highlighted here. 



http: //www. jmmc . f r/amberdrs 
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Figure 1. Top: comparison of visibilities (on various objects with different fluxes and integration times) obtained on 2T 
experiments with amdlib v2 (red dots) and amdlib v3 (black dots), with respect to the value obtained with a Fourier 
method (circles), taken as reference (given the recombination scheme of AMBER, only 2T experiments can be reduced 
both with the P2VM method and with a classical Fourier method). Bottom: visibility difference between each version of 
amdlib and the classical Fourier, showing the accuracy of the amdlib v3 solution. 

2. amdlib v3 CORE LIBRARY IMPROVEMENTS 

The amdlib core library, which is responsible for computing the instantaneous correlated fluxes and all the basic 
interferometric observables (V 2 , differential phases and phase closures), has been completely rewritten between 
versions 2 and 3. It implements most of the algorithms published by Chelli et al. (2009]P as well as workarounds 
of some of the problems audited by the AMBER Task Force teamP 

2.1 Data and Noise Model 

The amdlib v3 library implements the new algorithms based on an improved data and noise model as described 
in Chelli et al. (2009). 7 In a nutshell, the previous version of amdlib, based upon theoretical assumptions on 
the instrument, gave biased visibilities especially at low signal-to-noise ratios due to: 

• an incomplete data model overlooking both the presence of stray light and optical ghosts in the spectrograph 
and non-linearity effects in the detector at very low fluxes, 

• a too simplistic noise model. Both effects were enhanced at low S/N, where noise estimate and stray light 
level was becoming dominant. 

As shown in Fig. [TJ the biases at low fluxes have disappeared with amdlib v3. Actually these biases had less 
severe implications than it may appear here since they would be removed by the use of a calibrator of similar flux, 
which has always been enforced by the instrument's observation policy. More details are given in the reference 
publication.^ 

2.2 Algorithms 

A number of improvements were also added to the core library: 



The wavelength displacement between the three photometric beams is automatically taken into account. 
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Figure 2. The two panels produced by the amdlibShowP2vm routine. In the left-hand side are shown the intensities, 
visibilities and phases recorded during the P2VM exposures, as well as the flux level in the photometric and interferometric 
channels during the P2VM acquisition sequence. In the right-hand side are displayed the carrying waves (Ck, Dk) and 
the ratio between photometric and interferometric channels (14). These quantities are also represented in the top-right 
plot for a given wavelength, which can be selected by a left-click on any of the three figures. 

• In low-resolution mode, the algorithm detects the H-K interband phase shift and compensate the defects of 
repositioning of the spectrograph prism by displacing the wavelength table of the amount needed to bring 
the H-K interband to its nominal position. 

• amdlibv3 provides on-the-fiy bad pixel detection. 

• amdlibv3 uses a refined algorithm to compute pistons, and an heuristic scheme to evaluate this piston 
"goodness of fit" . Also, we added a piston closure algorithm to improve piston estimate. 

• amdlib v3 uses a goodness of fit test to tag individual visibilities which are not well fitted by the carrying 
waves of the interferogram. 

• similarly, the program tags all visibilities where one of the photometries is below a used-defined value (0 
being the default). 

• Finally, all bad values of the instantaneous or averaged interferometric observables are tagged in the OI- 
FITS file using the FLAG columns. 



3. YORICK USER INTERFACE 

The amdlib interface has been developed in Yorick, 6, an open-source interactive scientific language which provides 
a set of nice interactive graphics plot windows (see Figs. [2] [31 El and [5]). 

This Yorick front-end goes beyond the mere interface of the amdlib library functions as we specifically 
developed: 
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Figure 3. The two panels produced by a call to amdlibShowRawData for 3T data. 



1. a file-browser graphical user interface (GUI), completely written in vanilla yorick, 

2. advanced scripts to handle many files in batch mode, 

3. display commands to check the quality of the data, 

4. several functions to change the behavior of amdlib like the default values for the the different parameters. 

The file browser GUI is a side-development of amdlib, which is designed and provided as a separate module 
called yoco (for yorick contributions). This module also provides a cf itsio interface, a specific set of astronomy- 
related functions, plus several other utility scripts made to ease the use of some yorick functionality. For now 
this module is only distributed as a part of the amber data reduction package, but it will soon be distributed as 
a standalone yorick plugin since most of its functions could be used in contexts far beyond those of AMBER. 

3.1 Set of batch scripts 

A set of batch-mode scripts have all their names appended with "All" compared to the standard c-type amdlib 
functions. For example, the command-line C-filter proposes the commfunction amdlibComputeOiData, whereas 
the yorick command-line proposes both amdlibComputeOiData and amdlibComputeAllOiData. While the yorick 
function amdlibComputeOiData provides the same functionality as the C-filter complemented with a convenient 
GUI to select files graphically, the function amdlibComputeAllOiData computes the raw visibilities for a full 
night, automatically selecting observation, darks, and P2VM files. 

3.2 Diameter of calibrator stars 

This step consists in browsing all the calibration stars observed during a night and finding their associated 
angular diameters to correct in a further step their observed visibility from the expected one. 

A filter called amdlibSearchAllStarDiameters has been implemented^ to retrieve the diameters from the 
coordinates of the star included in the OI-FITS file, by browsing the CDS databasqj It has been included in 
amdlib v3 as amdlibQueryStarDiam and amdlibSearchAllStarDiameters. This filter fills in a text file located 
in a directory (the home directory by default) which contains a weighted-average of the diameters of the star 
found in all the known catalogs of stellar diameters. 



^http: //vizier .u- strasbg.fr 
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Figure 4. The two panels produced by a call to amdlibShowOiData for 3T data. This is the view for uncalibrated, 
instantaneous OI-FITS.Left: spectra on the 3 telescopes. Right, from top to bottom: closure phase histogram, flux 
histogram, flux ratio histogram, V 2 histogram and piston as a function of time. 



This filter was already browsing through the following list of catalogsP^HIH We have added two catalogs to 
the previous listP 

• the PTI catalog 16 which lists ss 500 Northern stars, and which has some overlap with other catalogs. 

• a catalog made of all possible queries through the JMMC SearchcaF] tooP^ (JMMC Stellar Diameter 
Catalog, JSDC). This tool is based on the work of Bonneau et al. (2006),^ which determines stellar 
diameters using a series of color-color relations, and which selects calibration stars using generic flags such 
as multiplicity or variability flags contained in the simbacF] database. The corresponding catalog contains 
w 38, 500 entries of calibration stars, up to the K-magnitude of sa 11.5. 

We added the possibility to retrieve the diameters using a local copy of the catalogs, which allows one to get the 
diameter even without an internet connexion. 

3.3 Absolute Calibration of Visibilities and Night Transfer Function 

The yorick interface of amdlib v3 aims at allowing the user to compute the transfer function throughout the 
night with identification of the different set-ups and calibrators. Then the user would choose the right time 
interval and the right wavelength range to produce calibrated data. We are testing new ways to automate the 
visibility calibration in order to provide this feature in a forthcoming version of amdlib. We provide in the early 
release of amdlib v3 a library called amdlibCalibrate and two alternative ways to calibrate: 
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Figure 5. The panel produced by a call to amdlibShowOiData for 3T OI data after frame selection. From top to bottom: 
baseline and interferometer configuration, spectra of the source in each beam, dispersed squared visibilities for each 
baselines, dispersed differential phases and closure phase. 
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Figure 6. Example of a night calibration for night 2008-01-01. The coloured markers are science objects and the black 
markers are calibrators. The solid and dashed lines correspond to the best estimate of the transfer function. 

• search the diameter of the calibrators in various catalogs described in Sect, using the Yorick com- 
mand amdlibSearchAHDiameters and then using the software suite provided by F. Millour consisting 
of: amdlibComputeAHTransf erFunction, amdlibShowTransf erFunctionVsTime, amdlibShowTransf er- 
FunctionVsWlen, and amdlibCalibrateOiData. 

• or search the diameters using the same amdlibSearchAllDiameters and then using the amdlibCalibrate- 
AllOiData provided by J.-B. Le Bouquin (see example in Fig.pl). 

4. APPLICATION TO LONG-TERM TRENDING OF AMBER 

We have applied amdlib v3 to the complete set of calibrator data retrieved from the ESO archive between May 
2004 and March 2010. It corresponds to 582 nights and 43, 087 files. The data has been reduced on a night-by- 
night basis using the amdlib. . .All. . . yorick scripts (see Sect. [3J). Then we retrieved their diameters using the 
command amdlibSearchAHStarDiameters in order to compute the intrinsic visibilities and therefore compute 
transfer function. The transfer function is computed by averaging the transfer function between 2.1 and 2.4 /im. 
Because sometimes the data were not consistent and could not lead to a visibility computation, because all 
calibrator data are not taken in the K band and because we have not found diameters for all targets, then the 
number of data fell from 5,400 to about 5,000 (by doing a more careful analysis, we would have kept much more 
data). The data (see Table[l]) has been stored in a "comma-separated- value" database file to be further analyzed 



Table 1. AMBER calibrator database (May 2004 - March 2010) 
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Figure 7. Time series of the transfer function with time from 2004 to 2010 on UTs (blue) and ATs (red) 
symbols are without fringe tracker and the crosses are with the fringe sensor FINITO. 
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with TOPCATpj] an interactive graphical viewer and editor for astronomical tabular data. 

Figure [7] shows the distribution of the transfer function in LRK with time. Before the installation of the ATs 
in 2007, the averaged transfer functions were low because of the high level of vibrations on the UTs. It never 
went above 30%. The averaged value then increases with time to up to 50% with the UTs and 60% with the 
ATs. After 2008, the transfer function increases again with the ATs after the replacement of the polarizer. Most 
of the observations taken with FINITO ensure a function transfer above 50% with ATs. 

Figure [8] shows the correlation between the averaged flux measured by AMBER in MRK and translated in 
K magnitude and the catalog if-magnitude. The number of photons received have been divided by the surface 
of the mirror and the detector integration time so that the values measured with ATs and UTs can be compared 
(see the two lines) . There is a difference of about 7 mag between the measured flux and the actual one leading 
to 0.15% of efficiency. However this takes into account not only the AMBER transmission but also the average 
seeing condition, the atmospheric absorption, the VLTI transmission,... In best cases, the total transmission is 
around 0.4%. Taking an atmospheric condition of 80%, VLTI transmission of 30%, a Strehl ratio of 0.3, this leads 
to an AMBER transmission of 5% which is very similar to what has been measured in the Assembly, Integration 
and Test report in 2004. 

Figure [9] gives the transmission (ratio of flux measured in Fig. [8]) measured on AMBER along the years. 
It seems that the instrument was correctly aligned in the beginning of the period and recently with a peak of 
transmission in spring 2006 when the AT commissioning occurred. An advice to ESO Paranal would be to follow 
these numbers in order to detect an anomalous lost of light. 



^http : //www . star . bris . ac . uk/~mbt/topcat/ 
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Figure 8. Correlation plots in MR-K between the actual flux measured on the y-axis and the catalog K magnitude on the 
x-axis. 
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Figure 9. Flux measured in function of time in AMBER. The magnitude is computed the same way as in the bottom left 
panel. 
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Figure 10. AMBER transfer function in presence of the fringe tracker FINITO . The plot represents the transfer function 
in function of the the residual RMS phase of FINITO. 
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Figure 11. Time series on a good RMS sequence in LR on ATs. Red symbols are baseline 12, blue ones are baselines 23 
and the remaining green symbols are baselines 13. 



Figure [10] displays the transfer function in presence of the fringe tracker FINITO as a function of the residual 
phase error of FINITO. The coherence time is also coded in colour. The lower the phase error on FINITO, the 
higher transfer function. Here again the performance is correlated with the value of the coherence time. This 
could be used to calibrate the response function of FINITO with AMBER. 

Figure [TT] represents the status of the transfer function when FINITO is used with good phase errors on the 
ATs. One sees that the transfer function remains stable with time and that the 3 baselines do not have exactly 
the same value which is due to the concept of multiaxial beam combination. 



5. CONCLUSION 

We have presented here amdlib v3 and its functionalities. We have applied this to a data base of calibrators 
showing the long-term trending of AMBER both in transmission and transfer function. 

The release to the community of the AMBER data reduction package containing amdlib v3 has been effective 
on 21 July 2010. All users are invited to download amdlib v3 and use it. Users should not hesitate to contact the 
JMMC User Support either by sending an email to jmmc-usr-support@obs.ujf-grenoble.fr or by visiting the 
JMMC support webpagql'lin case of problems. This version will be maintained and upgraded whenever possible. 
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